Real-time audience attention measurement and dashboard display

ABSTRACT

Embodiments of the present invention disclose a method, computer program product, and system for real-time determination of attentiveness of an audience in a room to a speaker. A computer determines amounts of wireless activity of a computing device within the room of the audience over time during the presentation. Based in part on the amounts of wireless activity of the computing device, the computer determines and initiates display of measures of attentiveness of the audience over the time during the presentation, to display changes in the measures of attentiveness of the audience to the speaker during the presentation. In another embodiment, the computer determines amounts of attentiveness of the audience within the room over time during the presentation utilizing sensors located throughout the room.

FIELD OF THE INVENTION

The present invention relates generally to the field of audienceattention measurement, and more specifically to real-time determinationof audience attention to a speaker.

BACKGROUND OF THE INVENTION

When giving a presentation to an audience, a speaker can observe theaudience to some degree, but experience difficulty assessing how theaudience is reacting to the speaker's presentation style, andpresentation materials. The audience can be engaging in sideconversations, utilizing mobile devices to access the internet, leavingthe room during the presentation, or looking away from the speaker ornot paying attention to the speaker. During presentations to largeaudiences, the speaker will have more difficulty assessing the degree towhich the audience is paying adequate attention.

It was known to automatically measure the response of an audience toprovided entertainment by US Pub. No.: US 2002/0073417 A1 by Kondo etal., teaching detection of an overall state of an audience, detection ofindividual states of members of an audience, and determining an audienceresponse on the basis of the detected information. A playback outputcontrol system first determines the response of an audience in a hall tothe object of entertainment such as a movie, and then controls theplayback of the movie and the like based on the thus determined audienceresponse. An audience response determination apparatus or in theplayback output control system can utilize images of the audience,sounds generated by the audience, loads applied to each of the seats byeach member of the audience, and a stepping force provided by eachmember of the audience to detect the overall state of the audience. Aplayback output control method comprises the steps of detecting anoverall state of an audience, detecting individual states of the membersof the audience, determining an audience response on the basis ofinformation detected by the steps of detecting the overall state of theaudience and detecting the individual states of the members of theaudience, and controlling the playback operation of data to be watchedor listened to by the audience on the base of the audience responsedetermined in the determination step.

SUMMARY

Embodiments of the present invention disclose a method, computer programproduct, and system for real-time determination of attentiveness of anaudience in a room to a speaker. A computer determines amounts ofwireless activity of a computing device within the room of the audienceover time during the presentation. Based in part on the amounts ofwireless activity of the computing device, the computer determines andinitiates display of measures of attentiveness of the audience over thetime during the presentation, to display changes in the measures ofattentiveness of the audience to the speaker during the presentation. Inanother embodiment, the computer determines amounts of attentiveness ofthe audience within the room over time during the presentation utilizingsensors located throughout the room.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

FIG. 1 is a functional block diagram of an attention measuring system inaccordance with an embodiment of the present invention.

FIG. 2 is a schematic of a sample room including elements of theattention measuring system of FIG. 1 in accordance with an embodiment ofthe present invention.

FIG. 3 is a flowchart of operational steps of an audience device usagemonitoring program of FIG. 1 for monitoring computing device usage foraudience members, in accordance with an embodiment of the presentinvention.

FIG. 4 is a flowchart of operational steps of an audience attentivenessmonitoring program of FIG. 1 for monitoring attentiveness of audiencemembers, in accordance with an embodiment of the present invention.

FIG. 5 is an exemplary depiction of an audience attention dashboardgenerated by an audience device usage monitoring program and an audienceattentiveness monitoring program of FIG. 1 which depicts a color-codedgraphical representation of audience device usage and audienceattentiveness, in accordance with an embodiment of the presentinvention.

FIG. 6 is a block diagram of components of the computers of FIG. 1.

DETAILED DESCRIPTION

The present invention will now be described in detail with reference tothe Figures. FIG. 1 is a functional block diagram illustrating attentionmeasuring system 100, in accordance with one embodiment of the presentinvention.

Attention measuring System 100 includes still cameras 110, video cameras112, microphones 114, motion sensors 116, computing device usagedetector 118, audience attention analysis engine 120, presentationanalysis engine 130, network 140, and audience attention dashboard 150.Still cameras 110, video cameras 112, microphones 114, motion sensors116, and computing device usage detector 118 are sensors operatingwithin a room in which a presentation is being made, and gatheringinformation corresponding to attention of individuals in the room. Stillcameras 110, video cameras 112, microphones 114, motion sensors 116, andcomputing device usage detector 118 send information to audienceattention analysis engine 120. For example, still cameras 110, videocameras 112, microphones 114, motion sensors 116, and computing deviceusage detector 118 are positioned in a room where a presentation isbeing given. Still cameras 110, video cameras 112, microphones 114,motion sensors 116, and computing device usage detector 118 are sensorsthat can gather information corresponding to an audience of apresentation in a unobtrusive manner (i.e. without affecting theexperience of the audience).

Still cameras 110 are devices capable of capturing images (i.e. digitalcameras) and sending the images to audience attention analysis engine120. For example, still cameras 110 take pictures of a room atpredetermined time intervals during a presentation or upon occurrencesof predetermined events such as a slide transition in a presentation orother events during a presentation, and send the pictures to audienceattention analysis engine 120. Video cameras 112 are devices capable ofcapturing videos (i.e. digital video cameras) and sending the videos toaudience attention analysis engine 120. For example, video cameras 112take continuous video of a room throughout a presentation and send thevideo to audience attention analysis engine 120. Microphones 114 aredevices capable of capturing and recording sound in various parts of aroom (i.e. directional microphones), and sending the sound recordings toaudience attention analysis engine 120. For example, microphones 114 areplaced throughout a room (i.e. on the backs of seats) where apresentation is occurring, continuously record sounds in the room (i.e.background noise, conversations between audience members), and send thesound recording to audience attention analysis engine 120. Microphones114 can be positioned throughout the room and on seats in the room todetect and locate sounds in the room (i.e. conversations betweenaudience members). Motion sensors 116 are devices capable of monitoringand recording movements of individuals in a room (i.e. getting up out ofa chair, movement while sitting in a chair), and send the recordedmovements to audience attention analysis engine 120. Motion sensors caninclude load sensors with capabilities for detecting movement (i.e.fidgeting) of an audience member within a seat. For example, motionsensors 116 are placed in chairs of audience members of a presentation,and send indications of movement in the audience members chairs toaudience attention analysis engine 120. Utilizing data from stillcameras 110, video cameras 112, microphones 114, and motion sensors 116to determine attentiveness of an audience as discussed in greater detailwith regards to FIG. 4.

Computing device usage detector 118 monitors network communications inand out of computing devices within an area. For example, computingdevice usage detector 118 monitors computing devices accessing theinternet through methods including WiFi®, mobile phone communications,and wired network connections. Computing device usage detector 118 isassociated with a wireless network of a presentation room, and canmonitor data (i.e. radio frequency signals, mobile phone communications,and other network communications) sent and received by computing devicesin the presentation room. Computing device usage detector 118 alsodetermines increases in network communications on computing devices(i.e. an increase in internet traffic) by detecting an increase in datasent or received by computing devices in the presentation room and theamount of the increase, and sends an indication of the increase innetwork communications to audience attention analysis engine 120.Utilizing data from computing device usage detector 118 to determinedevice usage for an audience is discussed in greater detail with regardsto FIG. 3.

Audience attention analysis engine 120 gathers information correspondingto an audience from still cameras 110, video cameras 112, microphones114, motion sensors 116, and computing device usage detector 118 andutilizes the information to determine attentiveness and device usage ofthe audience. Audience attention analysis engine 120 can be a computerprogram executing on desktop computers, specialized computer servers, orany other computer systems known in the art. In certain embodiments,audience attention analysis engine 120 represents a computer system withprogramming utilizing clustered computers and components (e.g., databaseserver computers, application server computers, etc.) that act as asingle pool of seamless resources when accessed by elements of attentionmeasuring system 100. In general, audience attention analysis engine 120is representative of any programmed electronic device or combination ofprogrammed electronic devices, as described in greater detail withregards to FIG. 6.

Audience attention analysis engine 120 includes audience device usagemonitoring program 300, audience attentiveness monitoring program 400,and sensor information 122. Sensor information 122 can be stored on anytype of storage device that is capable of storing data that may beaccessed and utilized by audience attention analysis engine 120, such asa database server, a hard disk drive, or flash memory. Sensorinformation 122 includes information that audience attention analysisengine 120 gathers from still cameras 110, video cameras 112,microphones 114, motion sensors 116, and computing device usage detector118. Audience device usage monitoring program 300 utilizes informationstored in sensor information 122 corresponding to computing device usagedetector 118 to determine device usage for an audience. Audience deviceusage monitoring program 300 is discussed in greater detail with regardsto FIG. 3. Audience attentiveness monitoring program 400 determinesattentiveness of an audience utilizing information stored in sensorinformation 122 corresponding to still cameras 110, video cameras 112,microphones 114, and motion sensors 116. Audience attentivenessmonitoring program 400 is discussed in greater detail with regards toFIG. 4.

Presentation analysis engine 130 includes completed presentations 132and audience attention information 134. In one embodiment, presentationanalysis engine 130 can be a computer program executing on desktopcomputers, specialized computer servers, or any other computer systemsknown in the art. In certain embodiments, presentation analysis engine130 represents a computer system utilizing clustered computers andcomponents (e.g., database server computers, application servercomputers, etc.) that act as a single pool of seamless resources whenaccessed by elements of attention measuring system 100. In general,presentation analysis engine 130 is representative of any programmedelectronic device or combination of programmed electronic devicescapable of executing machine-readable program instructions, as describedin greater detail with regards to FIG. 6. Presentation analysis engine130 allows an individual to view a completed presentation, andassociated audience attention information throughout the presentation.Audience attention reflects how closely an audience is playing attentionto an individual presenting (i.e. computing device usage,attentiveness). For example, an individual can see which portions of apresentation correspond to increased computing device usage for theaudience members based on real-time reporting of collective usage of thecomputing devices.

In one embodiment, completed presentations 132 stores completedpresentations analyzed by audience attention analysis engine 120. Inanother embodiment, audience attention information 134 storesinformation corresponding to audience attention information gathered andanalyzed by audience attention analysis engine 120 that corresponds to apresentation in completed presentations 132. For example, an individualutilizes audience device usage monitoring program 300 while giving apresentation. In this example, upon completion of the presentation,completed presentations 132 stores the presentation, and audienceattention information 134 stores audience attention information timedwith the presentation. Completed presentations 132 and audienceattention information 134 can be stored on any type of storage devicethat is capable of storing data that may be accessed and utilized bypresentation analysis engine 130, such as a database server, a hard diskdrive, or flash memory. In other embodiments, completed presentations132 and audience attention information 134 can be stored on multiplestorage devices within presentation analysis engine 120.

In one embodiment, elements of attention measuring system 100communicate through network 140. Network 140 can be, for example, alocal area network (LAN), a telecommunications network, a wide areanetwork (WAN) such as the Internet, or a combination of the three, andinclude wired, wireless, or fiber optic connections. In general, network140 can be any combination of connections and protocols that willsupport communications between still cameras 110, video cameras 112,microphones 114, motion sensors 116, computing device usage detector118, audience attention analysis engine 120, presentation analysisengine 130, network 140, and audience attention dashboard 150 inaccordance with exemplary embodiments of the present invention.

In exemplary embodiments, audience attention dashboard 150 provides amechanism to display data to a user and may be, for example, a computermonitor. Audience attention dashboard 150 can also function as a touchscreen, such as a display of a tablet computer. For example, audienceattention dashboard 150 receives audience attention information (i.e.audience device usage, audience attentiveness) from audience attentionanalysis engine 120. In this example, audience attention dashboard 150displays the audience attention information to an individual presentingto the audience. Sample audience attention dashboard 500 is an exemplarydepiction of audience attention dashboard 150 displaying audienceattention information.

FIG. 2 illustrates a sample room 200 in which a presentation is given.The room is equipped with computing device usage detector 118, audienceattention analysis engine 120, presentation podium 210, audienceattention dashboard 150, seating area 220, and cameras and microphones230. Computing device usage detector 118 and audience attention analysisengine 120 are previously discussed with regards to FIG. 1. In exemplaryembodiments, audience attention analysis engine 120 includes audiencedevice usage monitoring program 300 and audience attentivenessmonitoring program 400.

In one embodiment, presentation podium 210 includes audience attentiondashboard 150. Presentation podium 210 can be any stand or platform thatan individual can utilize to give a presentation. Presentation podium210 can include audience attention dashboard 150 so that an individualutilizing presentation podium 210 to give a presentation can viewaudience attention dashboard 150 while giving the presentation. Audienceattention dashboard 150 can be a mobile device, allowing removal ofaudience attention dashboard 150 from presentation podium 210. Audienceattention dashboard 150 is previously discussed in greater detail withregards to FIG. 1. In exemplary embodiments, seating area 220 is an areawhere an audience of the presentation can sit to view the presentation.Seats in seating area 220 include motion sensors 116 (previouslydiscussed with regards to FIG. 1). In one embodiment, cameras andmicrophones 230 include still cameras 110, video cameras 12, andmicrophones 114 (previously discussed with regards to FIG. 1). Camerasand microphones 230 are positions throughout sample room 200 to collectdata corresponding to attentiveness to the presentation of audiencemembers in seating area 220.

FIG. 3 is a flowchart depicting operational steps of audience deviceusage monitoring program 300 in accordance with an exemplary embodimentof the present invention. In one embodiment, audience device usagemonitoring program 300 initiates at the beginning of a presentation. Inother embodiments, a presentation can be a representation of one or moreindividuals communicating with an audience (i.e. presentation in ameeting, performance to an audience). FIG. 2 is an exemplary depictionof sample room 200, which audience device usage monitoring program 300operates in accordance with an exemplary embodiment of the invention.The audience device usage determined by audience device usage monitoringprogram 300 throughout a presentation is stored in audience attentioninformation 134 and associated with the presentation that is stored incompleted presentations 132, allowing the presenter to review deviceusage of the audience correlated to a time in the presentation.

In step 302, audience device usage monitoring program 300 determines anaudience device usage baseline level. In one embodiment, audience deviceusage monitoring program 300 utilizes computing device usage detector118 to determine a baseline level indicating a number of individuals inthe audience of the presentation using computing devices. In an examplewith regards to sample room 200, at the beginning of a presentationaudience device usage monitoring program 300 utilizes computing deviceusage detector 118 to determine individuals in seating area 220 that areutilizing a computing device to access the internet (i.e. wirelessactivity of a computing device). In this example, audience device usagemonitoring program 300 determines the number of individuals in seatingarea 220 that are utilizing a computing device to be the audience deviceusage baseline level by utilizing computing device usage detector 118 toidentify computing devices in seating area 220 that are sending andreceiving data. In another embodiment, audience device usage monitoringprogram 300 utilizes computing device usage detector 118 to determine alocation of individuals utilizing a computing device to access theinternet by identifying computing devices in seating area 220 that aresending and receiving data, and including the determined location in theaudience device usage baseline level. The location of devices can bedetermined to be a certain section of seating area 220, or at a specificlocation within seating area. In exemplary embodiments, audience deviceusage monitoring program 300 stores the determined audience device usagebaseline level and associated information from computing device usagedetector 118 in sensor information 122. In another embodiment, thebaseline level is determined as an average of audience device usage overa period of time at the beginning of the presentation. In an example, apresenter can indicate the period of time for the determination of thebaseline level (i.e. first few minutes of the presentation, a timeperiod excluding the first minute of the presentation, startingcorresponding with a certain slide of the presentation).

In step 304, audience device usage monitoring program 300 displays theaudience device usage baseline level on the audience attentiondashboard. In one embodiment, audience device usage monitoring program300 sends the determined audience device usage baseline level toaudience attention dashboard 150 through network 140. In an example withregards to sample room 200, audience device usage monitoring program 300displays the audience device usage baseline level on audience attentiondashboard 150, wherein the audience device usage baseline level appearson audience attention dashboard 150 as a color-coded graphicalrepresentation of device usage in seating area 220. A color-codedgraphical representation utilizes red/yellow/green indications to depictaudience device usage in seating area 220 (i.e. red indicating a highamount of device usage, yellow indicating an increased amount of deviceusage, and green indicating device usage close to the baseline level).Audience device usage monitoring program 300 displays the audiencedevice usage baseline level on audience attention dashboard 150 as agreen graphical representation, indicating that the audience deviceusage baseline level is normal for the environment of the presentation.

In step 306, audience device usage monitoring program 300 determines acurrent audience device usage level. In one embodiment, audience deviceusage monitoring program 300 utilizes computing device usage detector118 to determine a current audience device usage level indicating anumber of individuals in the audience of the presentation usingcomputing devices. In an example with regards to sample room 200,audience device usage monitoring program 300 utilizes usage detector 118to determine individuals in seating area 220 that are utilizing acomputing device to access the internet. In this example, audiencedevice usage monitoring program 300 determines the number of individualsin seating area 220 that are utilizing the computing device to be thecurrent audience device usage level. In another embodiment, audiencedevice usage monitoring program 300 utilizes computing device usagedetector 118 to determine a location of individuals utilizing acomputing device to access the internet, and includes the determinedlocation in the current audience device usage level. In exemplaryembodiments, audience device usage monitoring program 300 stores thedetermined current audience device usage level and associatedinformation from computing device usage detector 118 in sensorinformation 122. Audience device usage monitoring program 300 candetermine a current audience device usage level continuously throughouta presentation. For example, since the start of a presentation multipleindividuals in the audience have begun to utilize computing devices toaccess the internet (i.e. browse websites, check e-mail etc.). In thisexample, audience device usage monitoring program 300 identifies theseindividuals and includes the individuals in the determined currentaudience device usage level.

In decision step 308, audience device usage monitoring program 300determines whether the current audience device usage level is differentthan the audience device usage baseline level. In one embodiment,audience device usage monitoring program 300 compares the currentaudience device usage level (from step 306) to the audience device usagebaseline level (from step 302) that are stored in sensor information122. In exemplary embodiments, audience device usage monitoring program300 compares the number of individuals utilizing computing devices inthe current audience device usage baseline level and the audience deviceusage baseline level. In another embodiment, audience device usagemonitoring program 300 compares the location in the room of individualsutilizing computing devices in the current audience device usagebaseline level and the audience device usage baseline level. If audiencedevice usage monitoring program 300 determines than the current audiencedevice usage level is not different that the audience device usagebaseline level, audience device usage monitoring program 300 repeatsstep 306. In a first example with regards to sample room 200, audiencedevice usage monitoring program 300 determines an increased number ofindividuals utilizing computing devices to access the internet inseating area 220 and the locations within seating area 220 of theindividuals utilizing computing devices to access the internet.

In step 310, audience device usage monitoring program 300 displayscurrent audience device usage level on the audience attention dashboard.In one embodiment, if audience device usage monitoring program 300determines that the current audience device usage level (step 306) isdifferent than the audience device usage baseline level (step 302),audience device usage monitoring program 300 sends data related to thedetermined current audience device usage level through network 140 fordisplay on audience attention dashboard 150. In an example with regardsto sample room 200, audience device usage monitoring program 300displays the current audience device usage level on audience attentiondashboard 150 in the form of a color-coded graphical representation(discussed with regards to step 304).

In another embodiment, audience device usage monitoring program 300utilizes pre-defined threshold values indicating amounts of device usagethat correspond to red/yellow/green on the color-coded graphicalrepresentation display of audience attention dashboard 150. In the firstexample (previously discussed in decision step 308), audience deviceusage monitoring program 300 displays an updated color-coded graphicalrepresentation on audience attention dashboard 150 depicting theincreased number of individuals utilizing computing devices to accessthe internet in seating area 220, and the corresponding locations of theindividuals. In this example, FIG. 5 depicts sample audience attentiondashboard 500 displaying the current audience device usage level,wherein display 510 indicates a shaded in area representing a greenportion of the color-coded graphical representation (i.e. similar to theaudience device usage baseline level), and a non-shaded in arearepresenting a yellow portion of the color-coded graphicalrepresentation. The yellow portion of the color-coded graphicalrepresentation in display 510 indicates a section of seating area 220where an increased number of individuals are utilizing computing devicesto access the internet compared to the audience device usage baselinelevel. In another embodiment, audience device usage monitoring program300 includes a pre-defined threshold value indicating that if aspecified number of individuals in the audience are utilizing computingdevices to access the internet, the one or more individual presentinghas lost the audience. With regards to the first example, if the numberof individuals utilizing computing devices to access the internet isgreater than the pre-defined threshold value, audience device usagemonitoring program 300 displays the current device usage level onaudience attention dashboard 150 along with an indication that theaudience is lost (i.e. text in the color-coded graphical representation,a lost light indicator). In exemplary embodiments, audience device usagemonitoring program 300 repeats throughout the presentation, providingreal-time feedback of audience device usage.

FIG. 4 is a flowchart depicting operational steps of audienceattentiveness monitoring program 400 in accordance with an exemplaryembodiment of the present invention. In one embodiment, audienceattentiveness monitoring program 400 initiates at the beginning of apresentation. In other embodiments, a presentation can be arepresentation of one or more individuals communicating with an audience(i.e. presentation in a meeting, performance to an audience). FIG. 2 isan exemplary depiction of sample room 200, which audience device usagemonitoring program 300 operates in accordance with an exemplaryembodiment of the invention. The audience attentiveness determined byaudience attentiveness monitoring program 400 throughout a presentationis stored in audience attention information 134 and associated with thepresentation that is stored in completed presentations 132, allowing thepresenter to review attentiveness of the audience correlated to a timein the presentation.

In step 402, audience attentiveness monitoring program 400 determines anaudience attentiveness baseline level. In one embodiment, audienceattentiveness monitoring program 400 utilizes information from stillcameras 110, video cameras 112, microphones 114 and motion sensors 116to determine a baseline level indicating attentiveness of the audienceof the presentation. In an example with regards to sample room 200, atthe beginning of a presentation audience attentiveness monitoringprogram 400 utilizes information from cameras and microphones 230 (whichincludes still cameras 110, video cameras 112, and microphones 114), andmotion sensors 116 in seating area 220 to determine attentiveness ofindividuals in seating area 220. In exemplary embodiments, a baselinelevel can be determined for each sensor (i.e. a baseline value formicrophones 114, a baseline value for motion sensors 116, a baselinevalue for still cameras 110, and a baseline value for video cameras112).

In exemplary embodiments, audience attentiveness monitoring program 400utilizes information from still cameras 110 and video cameras 112 placedthroughout the room (i.e. cameras and microphones 230 in sample room200) to determine baseline images, video and sounds of the audience thataudience attentiveness monitoring program 400 can utilize forcomparisons throughout the presentation. In an example, audienceattentiveness monitoring program 400 utilizes pictures and video fromstill cameras 110 and video cameras 112 to identify movement ofindividuals in the audience, individuals looking at the presenter andlocations of the identified individuals in seating area 220. Audienceattentiveness monitoring program 400 can utilize eye detection todetermine whether individuals in seating area 220 are looking at thepresenter. Eye detection of audience members can be accomplishedutilizing eye and facial recognition capabilities of cameras. In oneexample, still cameras 110 and video cameras 112 can identify reflectionof light out of the retina to determine that an audience member islooking at the presenter. For example, audience attentiveness monitoringprogram 400 determines identified information from still cameras 110 andvideo cameras 112 (i.e. audience movement, audience looking atpresenter, and locations) to determine the audience attentivenessbaseline level corresponding to still cameras 110 and video cameras 112.In an example, audience attentiveness monitoring program 400 utilizessound from microphones 114 to identify side conversations occurringbetween individuals in seating area 220, and locations of the identifiedside conversations. Audience attentiveness monitoring program 400 canutilize microphones 116 that are places on seats in seating area 220 todetermine locations where side conversations are occurring. For example,audience attentiveness monitoring program 400 determines identifiedinformation from microphones 114 (i.e. side conversations in audience,location of side conversations, and volume of side conversations) todetermine the audience attentiveness baseline corresponding tomicrophones 114. To determine a baseline level for microphones 114,audience attentiveness monitoring program 400 can identify a decibellevel corresponding to microphones 114 (i.e. a decibel level associatedwith each microphone, a decibel level associated with a grouped sectionof microphones in an area).

In exemplary embodiments, audience attentiveness monitoring program 400utilizes information from motion sensors 116 located in seating area 220of sample room 200 to determine baseline movements and locations withinseating area 220 of the audience that audience attentiveness monitoringprogram 400 can utilize for comparisons throughout the presentation. Inan example, audience attentiveness monitoring program 400 utilizesmovement information from motion sensors 116 to identify movement ofindividuals in seating area 220 (i.e. individuals fidgeting withinseats), and where individuals are sitting (i.e. occupied seats inseating area 220) in seating area 220. Audience attentiveness monitoringprogram 400 can utilize load sensing capabilities of motion sensors 116located in each seat to identify which seats are occupied, and theamount of movement of individuals in occupied seats. For example,audience attentiveness monitoring program 400 determines identifiedinformation from motion sensors 116 (i.e. occupied seats, and movementwithin occupied seats) to determine the audience attentiveness baselinelevel corresponding to motion sensors 116. To determine a baseline levelfor motion sensors 116 audience attentiveness monitoring program 400 candetect movement (i.e. fidgeting) within seats, and a time associatedwith the movement (i.e. frequency of movement, or a duration ofmovement) utilizing load sensing capabilities of motion sensors 116. Inexemplary embodiments, audience attentiveness monitoring program 400stores the determined information corresponding to the audienceattentiveness baseline level associated with still cameras 110, videocameras 112, microphones 114, and motion sensors 116 in sensorinformation 122. In another embodiment, the baseline level is determinedas an average of audience attentiveness over a period of time at thebeginning of the presentation. In an example, a presenter can indicatethe period of time for the determination of the baseline level (i.e.first few minutes of the presentation, a time period excluding the firstminute of the presentation, starting corresponding with a certain slideof the presentation).

In step 404, audience attentiveness monitoring program 400 displaysaudience attentiveness baseline level on the audience attentiondashboard. In one embodiment, audience attentiveness monitoring program400 sends the determined audience attentiveness baseline level toaudience attention dashboard 150 through network 140. In an example withregards to sample room 200, audience attentiveness monitoring program400 displays the audience attentiveness baseline level on audienceattention dashboard 150, wherein the audience attentiveness baselinelevel appears on audience attention dashboard 150 as a color-codedgraphical representation of seating area 220 (color-coded graphicalrepresentation parameters discussed with regards to step 304 of audiencedevice usage monitoring program 300). Audience attentiveness monitoringprogram 400 displays the audience attentiveness baseline level onaudience attention dashboard 150 as a green graphical representation,indicating that the audience attentiveness baseline level is normal forthe environment of the presentation.

In step 406, audience attentiveness monitoring program 400 determines acurrent audience attentiveness level. In one embodiment, audienceattentiveness monitoring program 400 utilizes still cameras 110, videocameras 112, microphones 114, and motion sensors 116 to determine acurrent audience attentiveness level for the audience of thepresentation. In an example with regards to sample room 200, audienceattentiveness monitoring program 400 utilizes information from camerasand microphones 230 (which includes still cameras 110, video cameras112, and microphones 114), and motion sensors 116 in seating area 220 todetermine attentiveness of individuals in seating area 220. Exemplarymethods for utilizing still cameras 110, video cameras 112, microphones114, and motion sensors 116 to determine attentiveness of individuals inan audience (i.e. seating area 220) are discussed with regards to step402. In exemplary embodiments, audience attentiveness monitoring program400 stores the determined current attentiveness level and associatedinformation from still cameras 110, video cameras 112, microphones 114,motion sensors 116 in sensor information 122. Audience attentivenessmonitoring program 400 can determine a current audience attentivenesslevel continuously throughout a presentation. For example, since thestart of a presentation multiple individuals in the audience haveexhibited indications of decreased attentiveness (i.e. not looking up atthe individual presenting, engaging in side conversations, and fidgetingwithin seats). In this example, audience attentiveness monitoringprogram 400 utilizes still cameras 110, video cameras 112, microphones114, motion sensors 116 to identify and locate individuals in theaudience exhibiting indications of decreased attentiveness, and includesthe identified individuals in the determined current audienceattentiveness level. In another embodiment, when microphones 114 detectapplause, audience attentiveness monitoring program 400 does not includethe applause to indicate a decrease in audience attentiveness.

In decision step 408, audience attentiveness monitoring program 400determines whether the current audience attentiveness level is differentthan the audience attentiveness baseline level, In one embodiment,audience attentiveness monitoring program 400 compares the currentaudience attentiveness level (from step 406) to the audienceattentiveness baseline level (from step 402) that are stored in sensorinformation 122. In exemplary embodiments, audience attentivenessmonitoring program 400 compares information associated with stillcameras 110, video cameras 112, microphones 114, motion sensors 116 inthe current audience attentiveness level with the audience attentivenessbaseline level.

For example, audience attentiveness monitoring program 400 utilizespictures and video from still cameras 110 and video cameras 112 todetermine whether a difference exists between the current audienceattentiveness level and the audience attentiveness baseline level. Inthis example, audience attentiveness monitoring program 400 can identifywhether differences exist in movement of individuals in the audience,individuals looking up at the presenter (eye detection), and locationsof the identified individuals in seating area 220. In another example,audience attentiveness monitoring program 400 utilizes sound frommicrophones 114 to determine whether a difference exists between thecurrent audience attentiveness level and the audience attentivenessbaseline level. In this example, audience attentiveness monitoringprogram 400 can identify whether differences exist in side conversationsoccurring between individuals in seating area 220 (number ofconversations and volume of conversations), and locations of theidentified side conversations. In another example, audienceattentiveness monitoring program 400 utilizes movement and locationinformation from motion sensors 116 to determine whether a differenceexists between the current audience attentiveness level and the audienceattentiveness baseline level. In this example, audience attentivenessmonitoring program 400 can identify whether differences exist inmovement of individuals in seating area 220 (i.e. individuals fidgetingwithin seats), and where individuals are sitting (i.e. occupied seats inseating area 220) in seating area 220. If audience attentivenessmonitoring program 400 determines that the current audienceattentiveness level is not different than the audience attentivenessbaseline level, audience attentiveness monitoring program 400 repeatsstep 406. In a first example with regards to sample room 200, audienceattentiveness monitoring program 400 determines individuals in theaudience have left seats in a section of seating area 220 (throughutilization of motion sensors 116), side conversations are occurring atan increased frequency in a section of seating area 220 (throughutilization of microphones 114), and individuals in a section of seatingarea 220 are not looking at the individual presenting (throughutilization of still cameras 110 and video cameras 112).

In step 410, audience attentiveness monitoring program 400 displayscurrent audience attentiveness level on the audience attentiondashboard. In one embodiment, if audience attentiveness monitoringprogram 400 determines that the current audience attentiveness level(step 406) is different than the audience attentiveness baseline level(step 402), audience attentiveness monitoring program 400 sends thedetermined current audience attentiveness level through network 140 fordisplay on audience attention dashboard 150. In an example with regardsto sample room 200, audience attentiveness monitoring program 400displays the current audience attentiveness level on audience attentiondashboard 150 in the form of a color-coded graphical representation(discussed with regards to step 404). In another embodiment, audienceattentiveness monitoring program 400 utilizes pre-defined thresholdvalues indicating amounts of device usage that correspond tored/yellow/green on the color-coded graphical representation display ofaudience attention dashboard 150.

In the first example (previously discussed in decision step 408),audience attentiveness monitoring program 400 displays an updatedcolor-coded graphical representation on audience attention dashboard 150depicting individuals in the audience have left seats in a section ofseating area 220, side conversations are occurring at an increasedfrequency in a section of seating area 220, and individuals in a sectionof seating area 220 are not looking at the individual presenting. Inthis example, FIG. 5 depicts sample audience attention dashboard 500displaying the current audience attentiveness level, wherein display 510indicates a shaded in area representing a green portion of thecolor-coded graphical representation (i.e. similar to the audienceattentiveness baseline level), and a non-shaded in area representing ayellow portion of the color-coded graphical representation. The yellowportion of the color-coded graphical representation in display 510indicates a section of seating area 220 where individuals in theaudience have left seats in seating area 220, side conversations areoccurring at an increased frequency in seating area 220, and individualsin seating area 220 are not looking at the individual presenting incomparison to the audience attentiveness baseline level. In anotherembodiment, audience attentiveness monitoring program 400 includes apre-defined threshold value indicating that if a specified amount ofindividuals in the audience are exhibiting indications of decreasedattentiveness (in comparison to the audience attentiveness baselinelevel), the one or more individuals presenting have lost the audience.With regards to the first example and sample audience attentiondashboard 500, if the percentage of audience attention dashboard 150exhibiting indications of decreased attentiveness is greater than thepre-defined value (i.e. more than 50% of display 510 is yellow/red),audience attentiveness monitoring program 400 displays the currentaudience attentiveness level on audience attention dashboard 150 alongwith an indication that the audience is lost (i.e. text in thecolor-coded graphical representation, a lost light indicator). Inexemplary embodiments, audience attentiveness monitoring program 400repeats throughout the presentation, providing real-time feedback ofaudience device usage.

FIG. 5 is an exemplary depiction of sample audience attention dashboard500 in accordance with an exemplary embodiment of the present invention.In one embodiment, sample attention dashboard 500 is an exemplarydepiction on audience attention dashboard 150 displaying a color-codedgraphical representation on display 510. In exemplary embodiments,sample audience attention dashboard 500 displays information fromaudience device usage monitoring program 300 and audience attentivenessmonitoring program 400 in accordance with exemplary embodiments of thepresent invention.

Computing/processing devices audience attention analysis engine 120 andpresentation analysis engine 130 include respective sets of internalcomponents 800 a,b, and external components 900 a,b, illustrated in FIG.6. Each of the sets of internal components 800 a,b includes one or moreprocessors 820, one or more computer-readable RAMs 822 and one or morecomputer-readable ROMs 824 on one or more buses 826, one or moreoperating systems 828 and one or more computer-readable tangible storagedevices 830. The one or more operating systems 828, audience deviceusage monitoring program 300, audience attentiveness monitoring program400 and sensor information 122 (for audience attention analysis engine120), completed presentations 132 and audience attention information 134(for presentation analysis engine 130) are stored on one or more of therespective computer-readable tangible storage devices 830 for executionby one or more of the respective processors 820 via one or more of therespective RAMs 822 (which typically include cache memory). In theillustrated embodiment, each of the computer-readable tangible storagedevices 830 is a magnetic disk storage device of an internal hard drive.Alternatively, each of the computer-readable tangible storage devices830 is a semiconductor storage device such as ROM 824, EPROM, flashmemory or any other computer-readable tangible storage device that canstore but does not transmit a computer program and digital information.

Each set of internal components 800 a,b also includes a R/W drive orinterface 832 to read from and write to one or more portablecomputer-readable tangible storage devices 936 that can store but do nottransmit a computer program, such as a CD-ROM, DVD, memory stick,magnetic tape, magnetic disk, optical disk or semiconductor storagedevice. Audience device usage monitoring program 300, audienceattentiveness monitoring program 400 and sensor information 122 (foraudience attention analysis engine 120), completed presentations 132 andaudience attention information 134 (for presentation analysis engine130) can be stored on one or more of the respective portablecomputer-readable tangible storage devices 936, read via the respectiveR/W drive or interface 832 and loaded into the respective hard drive orsemiconductor storage device 830.

Each set of internal components 800 a,b also includes a network adapteror interface 836 such as a TCP/IP adapter card or wireless communicationadapter (such as a 4G wireless communication adapter using OFDMAtechnology). Audience device usage monitoring program 300, audienceattentiveness monitoring program 400 and sensor information 122 (foraudience attention analysis engine 120), completed presentations 132 andaudience attention information 134 (for presentation analysis engine130) can be downloaded to the respective computing/processing devicesfrom an external computer or external storage device via a network (forexample, the Internet, a local area network or other, wide area networkor wireless network) and network adapter or interface 836. From thenetwork adapter or interface 836, the programs are loaded into therespective hard drive or semiconductor storage device 830. The networkmay comprise copper wires, optical fibers, wireless transmission,routers, firewalls, switches, gateway computers and/or edge servers.

Each of the sets of external components 900 a,b includes a displayscreen 920, a keyboard or keypad 930, and a computer mouse or touchpad940. Each of the sets of internal components 800 a,b also includesdevice drivers 840 to interface to display screen 920 for imaging, tokeyboard or keypad 930, to computer mouse or touchpad 934, and/or todisplay screen for pressure sensing of alphanumeric character entry anduser selections. The device drivers 840, R/W drive or interface 832 andnetwork adapter or interface 836 comprise hardware and software (storedin storage device 830 and/or ROM 824).

The programs can be written in various programming languages (such asJava®, C+) including low-level, high-level, object-oriented or nonobject-oriented languages. Alternatively, the functions of the programscan be implemented in whole or in part by computer circuits and otherhardware (not shown).

Based on the foregoing, a computer system, method and program producthave been disclosed for real-time determination of audienceattentiveness to a speaker. However, numerous modifications andsubstitutions can be made without deviating from the scope of thepresent invention. Therefore, the present invention has been disclosedby way of example and not limitation.

What is claimed is:
 1. A method for real-time determination ofattentiveness of an audience in a room to a speaker making apresentation, the method comprising: a computer determining amounts ofwireless activity of a computing device within the room of the audienceover time during the presentation; and based in part on the amounts ofwireless activity of the computing device, the computer determining andinitiating display of measures of attentiveness of the audience over thetime during the presentation, to display changes in the measures ofattentiveness of the audience to the speaker during the presentation. 2.The method of claim 1, wherein lesser wireless activity corresponds togreater attentiveness of the audience.
 3. The method of claim 1, furthercomprising the step of: monitoring amounts of movement of members of theaudience over the time during the presentation; and wherein the measuresof attentiveness of the audience is also based in part on the amounts ofmovement of the members of the audience.
 4. The method of claim 1,further comprising the step of: monitoring levels of audible noise ofmembers of the audience over the time during the presentation; andwherein the measures of attentiveness of the audience is also based inpart on the amounts of audible noise of the members of the audience. 5.The method of claim 4, wherein the audible noise of members of theaudience does not include applause from members of the audience.
 6. Themethod of claim 1, further comprising the step of: recording thepresentation correlated with the determined measures of attentiveness ofthe audience, wherein the determined measures of attentiveness of theaudience correlate to the corresponding time in the presentation.
 7. Themethod of claim 1, wherein the computer initiating display of measuresof attentiveness of the audience over time during the presentationincludes an indication of whether the speaker has lost the audience. 8.A computer system for real-time determination of attentiveness of anaudience in a room to a speaker making a presentation, the computersystem comprising: one or more computer processors; one or morecomputer-readable storage devices; program instructions stored on thecomputer-readable storage media for execution by at least one of the oneor more processors, the program instructions comprising: programinstructions to determine amounts of wireless activity of a computingdevice within the room of the audience over time during thepresentation; and based in part on the amounts of wireless activity ofthe computing device, program instructions to determine and initiatedisplay of measures of attentiveness of the audience over the timeduring the presentation, to display changes in the measures ofattentiveness of the audience to the speaker during the presentation. 9.The computer system of claim 8, wherein lesser wireless activitycorresponds to greater attentiveness of the audience.
 10. The computersystem of claim 8, further comprising program instructions to: monitoramounts of movement of members of the audience over the time during thepresentation; and wherein the measures of attentiveness of the audienceis also based in part on amounts of movement of the members of theaudience.
 11. The computer system of claim 8, further comprising programinstructions to: monitor levels of audible noise of members of theaudience over the time during the presentation; and wherein the measuresof attentiveness of the audience is also based in part on the amounts ofaudible noise of the members of the audience.
 12. The computer system ofclaim 11, wherein the audible noise of members of the audience does notinclude applause from members of the audience
 13. The computer system ofclaim 8, further comprising program instructions to: record thepresentation correlated with the determined measures of attentiveness ofthe audience, wherein the determined measures of attentiveness of theaudience correlate to the corresponding time in the presentation. 14.The computer system of claim 8, wherein the program instructions toinitiate display of measures of attentiveness of the audience over timeincludes an indication of whether the speaker has lost the audience. 15.A computer system for real-time determination of attentiveness of anaudience in a room to a speaker making a presentation, the computersystem comprising: one or more computer processors; one or morecomputer-readable storage devices; program instructions stored on thecomputer-readable storage media for execution by at least one of the oneor more processors, the program instructions comprising: programinstructions to determine amounts of attentiveness of the audiencewithin the room over time during the presentation utilizing sensorslocated throughout the room; and based in part on amounts ofattentiveness the audience over time, program instructions to determineand initiate display of measures of attentiveness of the audience overthe time during the presentation, to display changes in the measures ofattentiveness of the audience to the speaker during the presentation.16. The computer system of claim 15, further comprising programinstructions to: monitor amounts of movement of members of the audienceover the time during the presentation; and wherein the measures ofattentiveness of the audience is also based in part on amounts ofmovement of the members of the audience.
 17. The computer system ofclaim 15, further comprising program instructions to: monitor levels ofaudible noise of members of the audience over the time during thepresentation; and wherein the measures of attentiveness of the audienceis also based in part on the amounts of audible noise of the members ofthe audience.
 18. The computer system of claim 17, wherein the audiblenoise of members of the audience does not include applause from membersof the audience
 19. The computer system of claim 15, further comprisingprogram instructions to: record the presentation correlated with thedetermined measures of attentiveness of the audience, wherein thedetermined measures of attentiveness of the audience correlate to thecorresponding time in the presentation.
 20. The computer system of claim15, wherein the program instructions to initiate display of measures ofattentiveness of the audience over time includes an indication ofwhether the speaker has lost the audience.